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BACKGROUND 

Two file archiving utilities for the Unix operating system are CPIO (copy in/out) 
and TAR (tape archiver). Both utilities can be used for backing up systems, or just to 
create file archives. They were originally intended to be used with a tape device, 
although, both create archive files on disk. Another utility, DUMP may also be used to 
backup a filesystem. A corresponding utility RESTORE restores data from a DUMP 
backup. RESTORE may be used interactively, to restore only certain files or directories. 

In BSD Unix, the TAR utility is implemented as a front-end to the utility PAX. 
PAX (in one mode) copies file operands to a destination directory. A file operand 
specifies the pathname of a file to be copied or archived. When a file operand does not 
select at least one archive member, PAX writes these file operand pathnames in a 
diagnostic message to standard error and then exits with a non-zero exit status. When no 
file operands are specified, a list of files to copy with one per line is read from the 
standard input. When a file operand is a directory, the entire file hierarchy rooted at that 
directory is included. The effect of the copy is as if the copied files were written to an 
archive file and then subsequently extracted, except that there may be hard links between 
the original and the copied files (see the -1 option). While processing a damaged archive 
during a read or list operation, PAX attempts to recover from media defects and searches 
through the archive to locate and process the largest number of archive members possible 
(see the -e option, for more details on error handling). 

The directory operand specifies a destination directory pathname. If the directory 
operand does not exist, or it is not writable by the user, or it is not of type directory, PAX 
exits with a non-zero exit status. A pattern operand may be used to select one or more 
pathnames of archive members. Archive members are selected using the pattern 
matching notation described by fhmatch(3). When the pattern operand is not supplied, all 
members of the archive are selected. When a pattern matches a directory, the entire file 
hierarchy rooted at that directory is selected. When a pattern operand does not select at 
least one archive member, PAX writes the pattern operands in a diagnostic message to 
standard error and then exits with a non-zero exit status. 

When writing an archive, block the output at a positive decimal integer number of 
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When writing an archive, block the output at a positive decimal integer number of 
bytes per write to the archive file. The blocksize must be a multiple of 512 bytes with a 
maximum of 32256 bytes. A blocksize can end with k or b to specify multiplication by 
1024 (IK) or 512, respectively. A pair of blocksizes can be separated by x to indicate a 
product. A specific archive device may impose additional restrictions on the size of 
blocking it will support. When blocking is not specified, the default blocksize is 
dependent on the specific archive format being used. The default block size for character 
special archive files is 10240. All blocksizes less than or equal to 32256 that are 
multiples of 512 are supported. 

Whenever PAX cannot create a file or a link when reading an archive or cannot 
find a file when writing an archive, or cannot preserve the user ID, group ID, or file mode 
when the -p option is specified, a diagnostic message is written to standard error and a 
non-zero exit status will be returned, but processing will continue. In the case where 
PAX cannot create a link to a file, PAX will not create a second copy of the file. If the 
extraction of a file from an archive is prematurely terminated by a signal or error, PAX 
may have only partially extracted a file the user wanted. Additionally, the file modes of 
extracted files and directories may have incorrect file bits, and the modification and 
access times may be wrong. 

If the creation of an archive is prematurely terminated by a signal or error, PAX 
may have only partially created the archive which may violate the specific archive format 
specification. If while doing a copy, PAX detects a file is about to overwrite itself, the 
file is not copied, a diagnostic message is written to standard error and when PAX 
completes it will exit with a non-zero exit status. 

File archival is also described in U.S. Patent 6,003,044 entitled "Method and 
Apparatus for Efficiently Backing up Files Using Multiple Computer Systems" by 
Pongracz, et al. that is incorporated by reference herein in its entirety. 

SUMMARY 

A method and system in accordance with one aspect of the invention perform 
archival in a computer, by creating a process if an item to be copied is a directory, and 
alternatively by copying the item if the item is a file. In one embodiment, the created 
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process in turn recursively performs the just-described acts, e.g. the act of creating or 
copying, with another item located in the just-described directory. Simultaneously (e.g. 
in case of two or more processors), or contemporaneously (in case of a single processor), 
the parent of the created process repeats the act of creating or copying with another item. 
5 Use of multiple processes speeds up archival, as compared to the use of a single process. 
Therefore, depending on the number of directories to be copied, a corresponding number 
of processes are created. In one embodiment, the number of created processes is limited 
by a maximum limit specified by an operator. When such a limit is specified, the creating 
process waits for the number to fall below the limit, before creating another process. 

10 In accordance with another aspect of the invention, a copy process changes a 

default limit on a resource to a maximum limit for the resource prior to copying. For 
example, prior to creation of a process, the parent process (or the parent's parent) may 
change the limits, so that all processes created thereafter inherit the new limits. Examples 
of resources include: the number of open files, the file size, and the amount of available 
1 5 memory (which may be stack and/or heap). Increase of the limit on such resources helps 
yj in speeding up archival. 

D In accordance with yet another aspect of the invention, a copy process is speeded 

2 U P by transferring data from the file into a temporary buffer, locking the temporary 

W buffer, and invoking a direct memory access (DMA) process for making a copy from the 

L=k 20 temporary buffer. The copy process may be further speeded up by checking for circular 

links (such as a symbolic link that points to itself), and eliminating time otherwise spent 

by prior art techniques in attempting to copy circular links. 

In accordance with still another aspect of the invention, a copy process sends an 
email message if a resource at a destination is full, and thereafter waits to be restarted 

25 subsequent to sending the email message. The process may identify an email address for 
such a message from a password file, based on an identity of a user that started the 
process. A user that receives the email may make appropriate arrangements (e.g. delete 
files in a destination disk or load a new disk), and therafter restart the process. On being 
restarted, the process recopies a file (from the beginning of the file) if it was in the middle 

30 of copying the file when it stopped. 



-3- 



M-9213US 
707538 vl 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 A illustrates, in a high-level block diagram, a system of one embodiment, 
for archival of files from multiple sources to multiple destinations. 

FIG. 1 B illustrates, in an intermediate-level block diagram, use of multiple 
5 processes in the system of FIG. 1 A, to perform copying. 

FIG. 1C illustrates, in a low-level block diagram, a circular link in a source of 
FIG. 1A. 

FIG. 2A illustrates, in a high-level flow chart, acts performed in one embodiment . 
by a process of FIG. IB. 

1 0 FIG. 2B illustrates, in a lower level flow chart, acts performed in a copy operation 

illustrated in FIG. 2A. 

DETAILED DESCRIPTION 

A method and apparatus in one embodiment of the invention perform archival in a 
1 5 computer (such as an IBM PC or a Sun workstation), by copying files from one or more 
sources 101A-101N (wherein A< I < N, N being the total number of sources) to one or 
more destinations 102 A- 102M (wherein A< J < M, M being the total number of 
destinations). In this embodiment, sources 101A-101N can be specified as one or more 
lists of file names, and/or as names of directories that are each to be copied as a whole. 
20 Alternatively, the user can identify a list (also called "excluded list") of files and/or 
directories that need to be excluded. 

Although FIG. 1A illustrates each file source 1011 as a disk and each destination 
102 J as another disk, such sources and destinations need not be disks, and instead could 
be tapes, or other storage media. Moreover, such sources and destinations can be all on 
25 the same storage media (e.g. on the same disk), rather than being on separate storage 
media, as would be apparent to the skilled artisan in view of the disclosure. 

When started (by a command to the operating system), a process that implements 
the method has access to resources based on limits (called "default limits"), which may be 
lower than maximum limits allowed for the process. Therefore, in an optional act, the 
30 process changes the default limits (as illustrated by act 1 1 1 in FIG. 2A), to the maximum 
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limits. Such changes may be implemented in the Unix operating system, by,a call to the 
system function "getrlimit" to identify the maximum limit, followed by a call to another 
system function "setrlimit" to set the maximum limit as the default. 

For example, a default limit on open files may be changed from 64 simultaneously 
5 open files to 1024 which is the maximum. In a similar manner other limits, such as stack 
size, heap size and file size are changed to their corresponding maximums. In one 
implementation, the heap size is not increased to its maximum, but to 1 0 less than the 
maximum, because on some platforms sometimes setting the limits to maximum was not 
successful. 

10 Note that the new limits do not affect the current process (that changes the limits), 

but instead affect any new processes spawned (or forked) from the current process. In 

y3 one implementation, the current process also sets itself as a process group (in an optional 

act not shown in FIG. 2A), so that termination of the current process terminates all 

=F processes spawned (or forked) from the current process. Next, in this implementation, 

yj 15 the current process spawns a new process that receives the new limits, and then the 

^ current process waits on completion of the new process. 

3 

Q In one implementation, the new process has two loops, an outer loop 112 (FIG. 

r\ 2 A) on all the sources 101 A- 10 IN, and an inner loop 113 (FIG. 2 A) on all files within 

w each source 1011. Inside these loops, the process checks (see act 1 14 of FIG. 2 A) if an 

20 item to be copied is a file and if so, simply copies the file (as illustrated by act 115). 
During such copying the file may be copied to multiple destinations, if specified. 

If the item is not a file, then if the item is a directory, the process checks (see act 
1 1 6 in FIG. 2A) if the number of processes that are currently executing is less than the 
maximum, and if so creates (see act 1 17) a new process and returns to loop 113, and 
25 otherwise waits (see act 118) until the number falls below the maximum. Therefore, the 
new process handles copying of the contents of the just-described directory, in a recursive 
manner. Depending on the implementation, such a process can have more loops or less 
loops (i.e. other than 2 loops). 

At any given time, several processes 103A-103P (wherein A< K < P, P being the 
30 total number of processes) may be performing copy operations, e.g. on a corresponding 
number of directories. These copy processes 103A-103P are in addition to (and are 
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spawned from) the above-described group process (not shown in FIG. IB). Therefore, it 
is not necessary for each of processes 103A-103P to be killed individually, and instead 
they are all killed when the group process is killed. 

Specifically, in one implementation, copy process 103K takes a source list the 
5 user has given, and opens each source directory, and traverses till the end, the complete 
tree. Prior to such tree traversal, copy process 103K first allocates memory for storing 
the absolute directory (complete name) and relative directory (current location of child), 
for use in identification and management (for use in creating the directory at the 
destination) of the files being copied. 

10 Copy process 103K also allocates memory to hold data from each file being 

copied. In this implementation, copy process 103K initially requests the operating system 
to provide the maximum limit (e.g. 1 GB), and if unsuccessful requests half the 
previously requested amount repeatedly, until successful. Depending on the sources 
101 A- 101 N, the allocated memory may be larger than the size of each of a majority of 

1 5 files to be copied. If so, such copying can be performed with a single read operation (per 
file) to a source 1011, thereby to minimize the overall input/output (I/O) operations as 
compared to a prior art process (such as "CPIO" or "TAR") that copies one block (e.g. of 
512 bytes) at a time. 

For example, copy process 103K can copy a 1 MB file into the allocated memory 
20 in a single read operation (if the allocated memory is larger than 1 MB). If the file size is 
larger than the allocated memory, then multiple reads are required, although the number 
of such reads is likely to be smaller than in the prior art (depending on the size of the 
allocated memory). For example, an 80 MB file may be copied in 4 read operations if the 
allocated memory is only 20 MB. 

25 In one implementation, copy process 103K checks that length of a directory name 

does not exceed a predetermined maximum length of a path (e.g. 1024). Next, copy 
process 103K stores in a stack the absolute and local paths to a current directory (e.g. by 
doing "sprintf 1 into a locally maintained stack, and changing a pointer inside the stack — 
the pointer moves up and down, always pointing to the beginning of the stack). 

30 . If an entry in a source directory is a symbolic link, then copy process 103K checks 

if the symbolic link is circular (i.e. points back to itself as illustrated in FIG. 1C) and if so 
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ignores the link. Process 103K does a traversal of the symbolic link, to find where the 
link is pointing to. For example, process 103K checks if current directory is pointing to 
parent directory, etc. Process 103K also checks if it is going beyond 1024 links when 
doing this check. Finally, process 103K does a string compare, and if it is the same file 
then it is a circular link. Process 103K also checks if the link is nonexistent or some junk, 
by checking if it exists. Process 103K calls "stat" which provides the statistics on the 
regular file from the system and "lstat" for link statistics. 

If the symbolic link is nonexistent (or junk), copy process 103K blindly preserves 
the symbolic link. Since processes 103A-103P operate in parallel, another process 103 A 
may be writing the file that is found to be "junk". So, process 103K processes only one 
directory, and the symbolic link may be to another directory that another process 1 03 A is 
still copying. Therefore, the pointer may become a valid pointer after process 103 A is 
completed. Process 103K keeps traversing a symbolic link until it finds (1) a regular file, 
(2) circular link or (3) nonexistent file (or junk). 

If the symbolic link points to a file or a directory, then a copy of the link is formed 
at the destination, and thereafter the following acts are performed (depending on the 
nature of the entry). If an entry in a source directory is (or a symbolic link points to) a 
file, then copy process 103K copies the file. Prior to copying the file, process 103K 
creates a directory at the destination. Specifically, process 103K combines the 
destination directory given by the user with relative directory and current directory name, 
to form the destination address. During directory creation, or file copying, process 103K 
preserves the time stamps and permissions. Also, during the directory creation or file 
copying if there is an error about insufficient space at the destination, process 103K sends 
email to the user and waits for the user (as discussed below in detail). When multiple 
destinations are specified, the waiting for user affects copying for all destinations, not just 
the destination having insufficient space. 

Note that process 103K performs a forcible copy, and if the destination file is 
previously there, then process 103K "unlinks" that file and copies the new file. Also, 
during the file copy itself, process 103K creates a destination file (if it already exists, 
process 103K does "unlink") and then process 103K truncates the file to 0 bytes. Process 
103K may get an error saying no space on disk, in which case process 103K sends email 
(as described below). 
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Also unlike a prior art process (such as "CPIO" or "TAR") that copies data one 
block (e.g. of 5 12 bytes) at a time, first into a user's area in memory and then into a kernel 
area, copy process 103K copies the data only once, directly into the above-described 
allocated memory, and thereafter invokes direct memory accesss (DMA) to copy the data 
from the allocated memory. Therefore, prior to any copying, copy process 103K locks 
the allocated memory, so that the memory is available during DMA. 

If an entry in the source directory is another directory, copy process 103K uses a 
limit "npp" on the number of parallel processes (which is specified by the user, and if user 
doesn't provide it, defaults to a predetermined number such as 10) to determine if another 
process can be created. For example, if the system has eight CPUs, the user may specify 
npp to be 8 or 16 (i.e. one process per CPU or two processes per CPU). Therefore, the 
process compares "npp" with a variable "cnp" which identifies the "current number of 
processes" and starts at 1 . If "cnp" is less than "npp" then the new process forks a child 
process. So, many processes operate in parallel, to perform copying of different 
directories. 

In one embodiment, a new process is not created for entries (also called "items") 
in a directory that are normally present and relate to the directory structure, such as the 
entries "." for current directory and for parent directory. Also, depending on the 
embodiment, a new process may not be created for the directory "lost+found" which is a 
directory created by the Unix operating system. Also, a new process may not be created 
if the directory is in an excluded list (described above). 

As noted above, when the destination disk is full, process 103K sends an email 
message to the operator. Specifically, process 103K sends the email to an address 
identified in an environmental variable "ALERTUSER". If this variable is not set, 
process 103K identifies the current user whoever is running the process, and identifies 
their email address (e.g. in Unix by reading the /etc/password to get user information, 
obtain the user's email id from the password file.) 

Next, process 103K creates a temporary file for holding the email message. If the 
disk doesn't have any space, process 103K creates a file whereever the disk space is 
available (e.g. in various directories such as \tmp or home directory of the user). Process 
103K only needs about 1 KB to hold the email message. Next, process 103K writes the 
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mail message into a temporary file, and then invokes a system command (e.g. mailx in 
Unix) to send the mail message. Then process 103K removes the file (e.g. by invoking 
the unlink function). Process 103K also sends a signal to itself to stop (e.g. 
kill(getpid(),SIGSTOP) in Unix). So, user is notified and process 103K is stopped at this 
5 time, and the user must cleanup somewhere to continue the copying. Next, user must 
send a continue signal to process 103K, after the user has cleaned up the disk. The user 
may issue a command "kill -CONT 'pid Mt in the Unix operating system, and then process 
103K continues its operation. The "kill" command is a system call that stops or starts the 
process. The mail message provides the process id to the user, which the user needs to 
10 restart the process. On restarting, process 103K starts back in the copy function, which 
resets the file descriptor to the beginning (the current minus the number of bytes we have 
q written). 

m Then process 103K re-writes the whole file (although in another embodiment it 

2 simply continues from where it left off, e.g. using "lseek" system call to move a file 

^ 15 pointer to anywhere inside the file). As process 103K knows the location of where the 
yj last character was written, it can continue. So, the destination file can be grown after 

L. clean up, with the operating system keeping track of where the blocks are located. Each 

=p block has a pointer to the next block, with the operating system updating the pointers. 

hi When asked to write a number of bytes to the disk, the operating system gets the free 

20 blocks, and sets up a pointer from one block to the next block. At the time of writing a 
large block (say 1GB block), operating system copies one block at a time. 

Note that instead of generating an email message when a destination disk is full, 
such email messages may be generated even when other errors are encountered, in which 
case the appropriate error notification is included in the email message. 

25 In one embodiment, process 103K performs the above-described traversal of a 

directory for all the files and directories therein, and if it sees a file it copies and 
otherwise forks a process also as noted above. During such a traversal if process 103K 
reaches maximum limit on the number of directories that can be held in the above- 
described stack which contains the absolute and local paths to a current directory. 

30 Process 103K does the same operations but calls itself in a recursive fashion (at the end) 
to use the operating system's memory normally used as stack area. Note that the above- 
described stack is limited in size because process 103K allocates the rest of the memory 
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for copying purposes (except for 4 bytes which contain two variables that identify the 
source file and destination file that is being copied at any given time). 

Therefore, when process 103K runs out of space allocated for the above-described 
stack, process 103K uses the operating system's stack space, by making recursive calls, 
5 and traverses through all the directories recursively. Recursive calls are not done until 
process 103K runs out of space for the above-described stack. The above-described stack 
is used for holding the list of directories that are being traversed (or need to be traversed 
depending on the implementation). The remaining allocated memory for process 103K 
holds global variables, and a temporary buffer for transferring the data from/to disk. As 
10 noted above, the temporary buffer is locked and DMA process is told to make a copy. 

„ One implementation of the method and system described herein is illustrated in a 

software description that is attached hereto as an Appendix (below). This specific 
[7j implementation performs a parallel copy, wherein the maximum number N of parallel 

J; process at any given time is a command line option, with one process being created for 

y 15 each directory. Such implementation can copy a list of directories, and when a -1 option 
7" is used the user can select directories that user wants to copy. Also, in such an 

O implementation, there can be multiple source directories and multiple destination 

C± directories. Such an implementation may also identify circular links, in order to avoid 

jfj looping. Also, such an implementation can preserve time stamp and permissions for the 

20 files being copied. Furthermore, such an implementation may overwrite files at the 
destination, unless the owner is not the same. 

Moreover, when a destination disk is full in the middle of a copy, this 
implementation sends email to ALERT_USER, which is an environment variable. If this 
varible is not set, the email is optionally sent to the userid who started the copy method, 

25 and the same information may be written to the terminal tty. Also, this implementation 
waits until disk space is available. If multiple destinations are selected, and one 
destination is out of disk space, this implemntation keeps other destinations waiting until 
disk space is available at the one destination. However, in this implementation, if 
multiple destinations are given and if those directories are NFS mounted, then if one 

30 network is slow other directories will also become slow. Such an implementation can be 
provided with an option to ignore certain specified files during the copy operation. Also, 
such an implementation can be provided with an option to not preserve symbolic links, 
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but to copy files in place of such links. 

Note that various functions and/or software and/or data structures described herein 
are not limited to use in an archival process, and instead may be used with other processes 
as will be apparent to the skilled artisan. For example, the user notification feature (e.g. 
use of an email message) can be used in a process that performs file download in a local 
computer from a remote computer. As another example, the user notification can be used 
in a disk defragmentation process, or in a process that performs virus checks as would be 
apparent to the skilled artisan in view of the disclosure. Therefore, any process that can 
run without the user's presence but which requires the user's assistance in certain 
situations can use the user notification feature when the situations arise. 

Numerous modifications and adaptations of the embodiments are encompassed by 
the attached claims. 
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APPENDIX 

Function getmntentO returns one entry from /etc/filesystems for each call. 
Returns : 0 if successfully found next entry; >0 if any error; and <0 on Eof. This function 
is implemented for platforms which do not provide "getmntent" in their standard libraries. 

5 Function getmnt_ent() returns next mount point. Calls function getmntentO- 

Function write_mesg() writes a mail message to the operator. Function 
write mesgO receives as inputs the following: a file name to which the message is to be 
written, a process id which identifies the process being stopped so that the process can be 
restarted by the operator, a source directory that identifies the location where the archival 
10 has been stopped, a destination directory that identifies the location at which the there 
was insufficient disk space, and name of the file system at the destination. Function 
write_mesg() includes instruction on how to restart the stopped process, e.g. contains the 
instruction "type 'kill -CONT pid' to continue copying" wherein pid is replaced with the 
process id described above. 

1 5 Function getDirNameO gets parent's directory name for the path. Function 

getDirName() receives as input the path and a character "ch" and returns a string till last 
occurence of ch. 

Function getmpointO returns mount point for a path by parsing through "." and "\" 
or "/" depending on the file system (Unix or Windows). Function getmpointO receives as 
20 input a pointer to the path. Calls functions getDirNameO getmnt_entO- 

Function sendmailO sends mail to the environmental variable ALERTJJSER (or 
if this is null to the operator that started this process) indicating disk is full. Function 
sendmail() first finds some temporary location to create a file to hold the message, e.g. in 
the 7tmp" directory, or user's home directory. Calls function write_mesgO. Receives as 
25 inputs the source path (which is simply passed to write_mesg), and the destination path 
(which is used with functions getDirName and getmpoint to identify the name of 
destination file system to function write_mesg). 

Function basenameO returns a string from the last occurence of the char ch to the 
end of a path. Receives as input path and character ch. 

30 Function readlnO reads next line from the file descriptor, and copies the line into 
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buffer and returns the number of bytes read. Specifically, it receives as input the file 
descriptor and a pointer to a buffer in which the line is stored, and it provides as output 
the number of bytes read. 

Function isFilelsDirO receives as input a path, and returns one of RT_DIR if path 
5 is a directory, RTFILE if path is a file, RT_SYM if path is a symbolic link, and 
RTJERR if there is an error or any spacial files or circular link. Checks if path is a 
symbolic link by looking at the attributes of the directory entry. For example, checks if 
(mode & S_IFMT) = S_IFLNK, wherein mode is of an entry in the directory, and if so, 
reads where path is linked to by making a system call readlink() If the path is linked to 

10 then returns RT_ERR due to circular link. Change directory to path and if successful 

return RTJS YM, and else path is not a sym link to regular file, so change back to 
working directory. If the path is linked to again return RT_ERR due to circular link. 
Also, string compare path with current directory, to see if the file is linked to itself, e.g. 
/tmp/foo -> /tmp/foo, and again returns RT_ERR due to circular link. Note that this 

1 5 function checks for circular links, both as absolute paths, and also as paths relative to the 
current directory. Calls function basename() to parse portions of a filename before and 
aftera"." 

Function copy() copies all files identified by an input variable src_file to a 
destination identified by another input variable dest_dirs, and a third input variable srcf 

20 holds the source filename only, and is used when the same source is copied to multiple 
destination directories. Loops on a variable "done" while the value is 0 which indicates 
that the src_file is a symbolic link. Inside the loop, function copy() checks if the user has 
opted to preserve the symbolic link, or copy the file/directory at the destination. If the 
user has opted to copy the file instead of a symbolic link, function copyO continues to 

25 loop until it finds a directory/file, or a circular link or a bad link. The default is for 

function copy() to keep (i.e. copy) symbolic links, if the user did not specify an option. If 
a file is found, function copy() copies the file. If a directory is found, function copy() 
copies the entire directory. If a bad link or a circular link is found, function copyO warns 
the user. During the looping, checks if the src_file is a symbolic link to relative path, i.e. 

30 compares the src_file to current location (obtained by calling function getDirName), and 
if so returns without any copying, but warning the user because a circular link is found. 
This function also checks if the directory entry has a link attribute, e.g. checks if mode 
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(as described above in reference to function isFilelsDir) and if it is a link it is necessary to 
recurse one more time, else checking if (mode & S_IFMT) = S_IFDIR) in which case 
variable done is set to 1 and otherwise to 2. Function copyO also spawns a new process 
("child") when done is 1 (because a directory is to be copied), and if the spawn fails 
5 simply sleeps for 5 seconds, and tries again. The new process ("child") performs the 
function scanDirs(). Function copyO also checks if the destination disk is full, and if so 
invokes function sendmail (described above) to wait for disk space to be made available. 

Function rec_dir() recursively travels into a directory till the end leaf, and copies 

if the leaf is regular file, makes symbolic link if a leaf is symlink, and otherwise creates a 
10 directory. One embodiment does not use recursive functioning due to stack growth. 

Receives as inputs two names, a relative directory name and an absolute directory name. 
S Checks if string length of the first name is greater than PATH_MAX (which is 1 024 in 

m one embodiment), and if so signals an error and returns. Reads the directory entries till 

Eof, and ignores ".", ".." and "lost+found" entries. Calls function isFileIsDir() with each 
33 15 file name, ignores any errors, and copies the entry if it is a file or a link. Creates 
\ii directories at destination. If the destination disk is full, function rec_dir() also invokes 

;L function sendmail (described above) to wait for disk space to be made available. 

=p Function rec_dir 0 is called by function scanDirsO when there is insufficient memory in 

the stack (i.e. overflow of stack), and by function copy() to traverse the directory which is 
M 20 a symbolic link and if the user opted not to preserve symbolic links. 

Function scanDirsO accepts two arguments, abspathofDir and relDirName. This 
function has two stacks, one for storing the absolute path of source directory (e.g. 
abspathofDir), and another for storing relative path from the source directory (e.g. 
relDirName). This function traverses the absolute path of the directory and does the 

25 following: if it finds a file or symbolic link, it calls function copy() to copy the file or 

link, and if it finds a directory it pushes the paths (both relative path and absolute path) to 
this directory into the stacks. The just-described action of copying or pushing on stack is 
repeated for each entry (which can be, e.g. a file, a link or a directory) in the current 
directory. This function, before copying, verifies should this file needs to be copied or 

30 not (user can have this file to be excluded). When creating a destination directory, if the 
destination disk is full, function scanDirsO a ls° invokes function sendmail (described 
above) to wait for disk space to be made available. When all entries in the current 
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directory have been processed, the stacks are popped (i.e. the values from the stacks are 
set to current directory) and the just-described operation is performed on the current 
directory. Such processing of directories from the stacks continues until the stacks are 
empty. In case of stack overflow, this function (i.e. scanDirs) calls function rec_dir 
(discussed in previous paragraph) to proceed from the directory. 

Function usageO echoes the user's usage of this tool. This function is called 
whenever the user uses the wrong options. 

Function exclude_thisfile () performs the following operation. Before copying 
each file, checks the file name in a specific file which contains a list of filenames to be 
excluded when the user uses an exclude option. Using this option slows down the 
copying process. 

Function make_arglist() checks the command line argument and overwrites the 
default values with the user-provided values. For example, the number of processes, by 
default is 10 but can be overwritten by the user. 

Function increase_limits() increases various resource limits, such as stack size, 
heap size, number of file open descriptors and file size. 

Function copy_srcfile() is called by the function main (described below) with the 
source file name and relative path as arguments. This function calls function copyO 
(described above) if source file name is a regular file or symbolic link. If it is a directory, 
this function checks the number of parallel processes running. If the number of parallel 
processes is less than a limit "numproc" (which may be set by the user; by default this 
number is set to 10), then it forks a child process, and the child process calls function 
scandirs (), and the parent process returns to the function main. 

Function main() calls function increase_limits 0 (described above), sets the 
process as a group leader, forks a child and waits for the child. Child calls function 
make_arglist() (described above), to verify command line arguments, and opens /dev/tty 
for writing messages to the user. Child then loops through all the source directories, to 
perform copying: scans each source directory and for each entry, calls function 
copy_srcfile (which spawns a child and returns as described above). On return, the child 
checks if exclude or include option is used. If exclude option is set in the command line 
option, then it calls function exclude_thisfile 0 (described above). If include option (i.e. 
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copy only listed files) is set, copies only the listed files instead of scanning the source 
directory (i.e. reads from the listed files and copies them by calling function 
copy_srcfile). If neither the exclude nor the include option are set, then the child calls 
function copy srcfile, thereby to recursively spawn additional child processes if 
necessary. On return from the function copy_srcfile, this child waits for all its child 
processes to finish. 
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